Systems and methods for dynamic interaction with an augmented reality environment

ABSTRACT

Methods and systems are provided for dynamic interaction with an augmented reality environment. In some embodiments, the systems and methods are directed at dynamically interacting with machinery within the augmented reality environment via an augmented reality device. The method involves analyzing a site in which the machinery is to be operated to capture environment data; displaying on the augmented reality device an augmented reality representation of the machinery as an overlay of a portion of an augmented reality environment; receiving an interaction request for interacting with the augmented reality representation of the machinery; determining whether the interaction request can be completed in respect of the machinery within the site; and in response to determining that the interaction request can be completed, displaying the augmented reality representation of the machinery in accordance with the interaction request, otherwise, indicating that the interaction request cannot be completed within the site.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.17/984,338 filed on Nov. 10, 2022, which claims benefit of U.S.Provisional Patent Application No. 63/394,716 filed on Aug. 3, 2022.Each of U.S. patent application Ser. No. 17/984,338 and U.S. ProvisionalPatent Application No. 63/394,716 is hereby incorporated by reference inits entirety.

FIELD

The described embodiments relate to systems and methods for dynamicinteraction with an augmented reality environment. In some embodiments,the systems and methods are directed at dynamically interacting withmachinery within the augmented reality environment.

BACKGROUND

As commerce transitions towards online platforms, there are aspects ofthe in-person experience that cannot be easily replaced. For example,physical access to the products and the people-to-people interaction aresome aspects of the in-person commerce experience that are critical tosome consumers. These aspects of the in-person commerce experience couldalso be important when acquiring certain physical property that mayrequire fuller inspection, such as expensive physical items (e.g.,equipment, jewelry, land, property, etc.).

Construction equipment, for example, is expensive and so, selecting thewrong piece of equipment can result in significant financial loss andconstruction project delays. When a customer is looking to acquire(whether by rental, lease, purchase, or other means) constructionequipment, the process can be difficult as each piece of equipment hasunique features and may be in varying (or unknown) working conditions.Due to the nature of such construction equipment and the trainingrequired to operate it, it may not be possible to fully test theequipment even if physical access to the equipment were available. Itcan also be difficult to determine whether the equipment would fitwithin the intended site. This acquisition process is even morecomplicated when conducted online since the customer would have nophysical access to the equipment.

SUMMARY

The various embodiments described herein generally relate to methods(and associated systems configured to implement the methods) for dynamicinteraction with an augmented reality environment. In some embodiments,the systems and methods are directed at dynamically interacting withmachinery within the augmented reality environment.

In accordance with an example embodiment, there is provided a method fordynamically interacting with machinery within an augmented realityenvironment via an augmented reality device. The method includesanalyzing, with the augmented reality device, a site in which themachinery is to be operated to capture environment data related to thesite; displaying on the augmented reality device an augmented realityrepresentation of the machinery as an overlay of a portion of anaugmented reality environment corresponding to the site; receiving aninteraction request via the augmented reality device for interactingwith the augmented reality representation of the machinery; determining,based on the captured environmental data, whether the interactionrequest can be completed in respect of the machinery within the site;and in response to determining that the interaction request can becompleted, displaying, on the augmented reality device, the augmentedreality representation of the machinery in accordance with theinteraction request, otherwise, indicating on the augmented realitydevice that the interaction request cannot be completed within the site.

In some embodiments, analyzing the site comprises capturing theenvironmental data for estimating a site boundary of the site in whichthe machinery is to be operated.

In some embodiments, analyzing the site comprises detecting one or moreobstacles for the machinery within the site.

In some embodiments, analyzing the site comprises continuing to analyzethe site during interaction with the augmented reality environment.

In some embodiments, determining whether the interaction request can becompleted for the machinery within the site comprises determiningwhether an operating range of the machinery for completing theinteraction request is restricted by one or more of the site boundaryand an obstacle within the site; and indicating on the augmented realitydevice that the interaction request cannot be completed within the sitecomprises indicating that the machinery is unsuitable for the site.

In some embodiments, indicating that the machinery is unsuitable for thesite comprises indicating the operating range of the machinery isrestricted by the one or more of the site boundary and the obstaclewithin the site.

In some embodiments, indicating that the machinery is unsuitable for thesite comprises recommending an alternative machinery suitable for thesite.

In some embodiments, recommending the alternative machinery suitable forthe site comprises: determining a weight category of a suitablemachinery for the site boundary based on the environment data;determining whether the machinery is available in the weight category;and in response to determining the machinery is available in the weightcategory, identifying the machinery associated with the weight categoryas the alternative machinery, otherwise, identifying the alternativemachinery as the suitable machinery associated with the determinedweight category and a similar functionality as the machinery.

In some embodiments, indicating on the augmented reality device that theinteraction request cannot be completed within the site comprisesrequesting the site to be analyzed again with the augmented realitydevice.

In some embodiments, the interaction request comprises substituting amachinery attachment on the machinery.

In some embodiments, the interaction request comprises operating theaugmented reality representation of the machinery within the augmentedreality environment.

In some embodiments, the interaction request comprises operating theaugmented reality representation of a machinery component of themachinery within the augmented reality environment.

In some embodiments, the augmented reality representation of themachinery comprises a three-dimensional model of the machinery.

In some embodiments, the three-dimensional model of the machinerycomprises a three-dimensional model of each machinery component.

In accordance with an embodiment, there is provided a system fordynamically interacting with machinery within an augmented realityenvironment via an augmented reality device. The system includes aprocessor configured to: receive environment data captured by theaugmented reality device related to a site in which the machinery is tobe operated; display on the augmented reality device an augmentedreality representation of the machinery as an overlay of a portion of anaugmented reality environment corresponding to the site; receive aninteraction request via the augmented reality device for interactingwith the augmented reality representation of the machinery; determine,based on the captured environmental data, whether the interactionrequest can be completed in respect of the machinery within the site;and in response to determining that the interaction request can becompleted, display, on the augmented reality device, the augmentedreality representation of the machinery in accordance with theinteraction request, otherwise, indicate on the augmented reality devicethat the interaction request cannot be completed within the site.

In some embodiments, the processor is further configured to: estimate asite boundary of the site in which the machinery is to be operated basedon the environment data.

In some embodiments, the processor is further configured to: detect oneor more obstacles for the machinery within the site.

In some embodiments, the processor is further configured to: continue toanalyze the site during interaction with the augmented realityenvironment.

In some embodiments, the processor is further configured to: determinewhether an operating range of the machinery for completing theinteraction request is restricted by one or more of the site boundaryand an obstacle within the site; and indicate that the machinery isunsuitable for the site when the operating range of the machineryrequired for completing the interaction request exceeds the siteboundary.

In some embodiments, the processor is further configured to: indicate onthe augmented reality device that the operating range of the machineryis restricted by the one or more of the site boundary and the obstaclewithin the site.

In some embodiments, the processor is further configured to: recommendon the augmented reality device an alternative machinery suitable forthe site when the machinery is unsuitable for the site.

In some embodiments, the processor is further configured to: determine aweight category of a suitable machinery for the site boundary based onthe environment data; determine whether the machinery is available inthe weight category; and in response to determining the machinery isavailable in the weight category, identify the machinery associated withthe weight category as the alternative machinery, otherwise, identifythe alternative machinery as the suitable machinery associated with thedetermined weight category and a similar functionality as the machinery.

In some embodiments, the processor is further configured to: request thesite to be analyzed again with the augmented reality device when theinteraction request cannot be completed within the site.

In some embodiments, the interaction request comprises substituting amachinery attachment on the machinery.

In some embodiments, the interaction request comprises operating theaugmented reality representation of the machinery within the augmentedreality environment.

In some embodiments, the interaction request comprises operating theaugmented reality representation of a machinery component of themachinery within the augmented reality environment.

In some embodiments, the augmented reality representation of themachinery comprises a three-dimensional model of the machinery.

In some embodiments, the three-dimensional model of the machinerycomprises a three-dimensional model of each machinery component.

In accordance with an embodiment, there is provided a method fordynamically interacting with an augmented reality environment via anaugmented reality device. The method includes analyzing, with theaugmented reality device, a site in which an object is to be placed tocapture environment data related to the site; displaying on theaugmented reality device an augmented reality representation of theobject as an overlay of a portion of an augmented reality environmentcorresponding to the site; receiving an interaction request via theaugmented reality device for interacting with the augmented realityrepresentation of the object; determining, based on the capturedenvironmental data, whether the interaction request can be completed inrespect of the object within the site; and in response to determiningthat the interaction request can be completed, displaying, on theaugmented reality device, the augmented reality representation of theobject in accordance with the interaction request, otherwise, indicatingon the augmented reality device that the interaction request cannot becompleted within the site.

In some embodiments, analyzing the site comprises capturing theenvironmental data for estimating a site boundary of the site in whichthe object is to be placed.

In some embodiments, analyzing the site comprises detecting one or moreobstacles for the object within the site.

In some embodiments, analyzing the site comprises analyzing the siteduring interaction with the augmented reality environment.

In some embodiments, determining whether the interaction request can becompleted for the object within the site comprises determining whetheran operating range of the object for completing the interaction requestis restricted by one or more of the site boundary and an obstacle withinthe site; and indicating on the augmented reality device that theinteraction request cannot be completed within the site comprisesindicating that the object is unsuitable for the site.

In some embodiments, indicating that the object is unsuitable for thesite comprises indicating the operating range of the object isrestricted by the one or more of the site boundary and the obstaclewithin the site.

In some embodiments, indicating that the object is unsuitable for thesite comprises recommending an alternative object suitable for the site.

In some embodiments, indicating on the augmented reality device that theinteraction request cannot be completed within the site comprisesrequesting the site to be analyzed again with the augmented realitydevice.

In some embodiments, the interaction request comprises operating theaugmented reality representation of the object within the augmentedreality environment.

In some embodiments, the augmented reality representation of the objectcomprises a three-dimensional model of the object.

In some embodiments, the object comprises a merchandisable item.

In accordance with an example embodiment, there is provided a system fordynamically interacting with an augmented reality environment via anaugmented reality device. The system includes a processor configured to:receive environment data captured by the augmented reality devicerelated to a site in which an object is to be placed; display on theaugmented reality device an augmented reality representation of theobject as an overlay of a portion of an augmented reality environmentcorresponding to the site; receive an interaction request via theaugmented reality device for interacting with the augmented realityrepresentation of the object; determine, based on the capturedenvironmental data, whether the interaction request can be completed inrespect of the object within the site; and in response to determiningthat the interaction request can be completed, display, on the augmentedreality device, the augmented reality representation of the object inaccordance with the interaction request, otherwise, indicate on theaugmented reality device that the interaction request cannot becompleted within the site.

In some embodiments, the processor is further configured to: estimate asite boundary of the site in which the object is to be placed.

In some embodiments, the processor is further configured to: detect oneor more obstacles for the object within the site.

In some embodiments, the processor is further configured to: analyze thesite during interaction with the augmented reality environment.

In some embodiments, the processor is further configured to: determinewhether an operating range of the object for completing the interactionrequest is restricted by one or more of the site boundary and anobstacle within the site; and indicate that the object is unsuitable forthe site.

In some embodiments, the processor is further configured to: indicatethat the operating range of the object is restricted by the one or moreof the site boundary and the obstacle within the site.

In some embodiments, the processor is further configured to: recommendan alternative object suitable for the site.

In some embodiments, the processor is further configured to: request thesite to be analyzed again with the augmented reality device.

In some embodiments, the interaction request comprises operating theaugmented reality representation of the object within the augmentedreality environment.

In some embodiments, the augmented reality representation of the objectcomprises a three-dimensional model of the object.

In some embodiments, the object comprises a merchandisable item.

BRIEF DESCRIPTION OF THE DRAWINGS

Several embodiments will now be described in detail with reference tothe drawings, in which:

FIG. 1 is a block diagram of components interacting with an exampledynamic interaction system in accordance with an example embodiment;

FIG. 2 is a screenshot of an example user interface from which thedynamic interaction system can be initiated;

FIG. 3 shows an example site and an augmented reality device beingoperated for capturing environment data of the site in accordance withan example embodiment;

FIG. 4 is a flowchart illustrating an example method for dynamicallyinteracting with an augmented reality environment;

FIG. 5 shows an augmented reality environment generated for the examplesite of FIG. 4 displayed on an example augmented reality device inaccordance with an example embodiment;

FIG. 6 shows the augmented reality environment of FIG. 5 overlaid withan example representation of machinery in accordance with an exampleembodiment;

FIG. 7A shows an example augmented reality interface with an examplealert generated by the dynamic interaction system in accordance with anexample embodiment;

FIG. 7B shows another example augmented reality interface from which aninteraction request can be received for operating the example machineryin accordance with an example embodiment;

FIG. 7C shows another example augmented reality interface with anotherexample alert generated by the dynamic interaction system in accordancewith an example embodiment;

FIG. 7D shows another example augmented reality interface with anotherexample alert generated by the dynamic interaction system in accordancewith an example embodiment;

FIG. 8 shows another example augmented reality interface from which aninteraction request can be received for selecting different attachmentsfor an example machinery in accordance with an example embodiment;

FIG. 9A shows another example augmented reality interface from which theexample machinery can be acquired; and

FIG. 9B shows an example checkout interface for completing a transactionin respect of the machinery.

The drawings, described below, are provided for purposes ofillustration, and not of limitation, of the aspects and features ofvarious examples of embodiments described herein. For simplicity andclarity of illustration, elements shown in the drawings have notnecessarily been drawn to scale. The dimensions of some of the elementsmay be exaggerated relative to other elements for clarity. It will beappreciated that for simplicity and clarity of illustration, whereconsidered appropriate, reference numerals may be repeated among thedrawings to indicate corresponding or analogous elements or steps.

DESCRIPTION OF EXAMPLE EMBODIMENTS

The various embodiments described herein generally relate to methods(and associated systems configured to implement the methods) for dynamicinteraction with an augmented reality environment. In some embodiments,the systems and methods are directed at dynamically interacting withmachinery within the augmented reality environment. The interaction withthe machinery can include, but is not limited to, components of themachinery, such as, machine arms and attachments. In some embodiments,the systems and methods are directed at dynamically interacting withmerchandisable items including, but without limitation, constructionequipment, vehicular equipment, agricultural equipment, andmanufacturing equipment, and/or any compatible accessories, within theaugmented reality environment.

Augmented reality enables an interactive experience for a user via anaugmented reality device. The augmented reality experience involves areal-world environment that is “enhanced” with overlaidcomputer-generated information on the augmented reality device. Theoverlaid information can be added to the real-world environment asgenerated on the augmented reality device or can be used to mask aportion of the real-world environment on the augmented reality device.Other sensory information (e.g., auditory, motion, etc.) can be added tothe augmented reality experience.

Augmented reality technology is often confused with virtual realitysolutions. In contrast to augmented reality, virtual reality replacesthe user's real-world environment with a simulated environment. Virtualreality technology is typically delivered through virtual realityheadsets, which presents simulated visual and audio information to theuser such that the user becomes fully immersed in the virtual world.

With commerce transitioning towards online platforms, there are aspectsof the in-person experience that cannot be easily replaced. In general,many consumers enjoy being able to physically access the physical itemor property to be acquired (whether by rental, lease, purchase or othermeans). In addition to the in-person experience, there are physicalitems or property that justify a fuller inspection prior to completingthe purchase. For example, expensive physical items (e.g., equipment,jewelry, etc.), and land or property normally warrants a deeperinspection prior to such a financial investment. Solutions driven byaugmented reality technology can improve this transition.

One advantage of online commerce platforms is that consumers can acquiremerchandisable items wherever they may be located and can also acquireitems from nearly anywhere in the world. The systems and methodsdisclosed herein enable a user to dynamically interact with an augmentedreality environment representing an intended site for the merchandisableitem. With the systems and methods disclosed herein, users can obtainenvironment data of the intended site to determine a boundary of thesite and/or any relevant obstacles. Example methods of obtaining theenvironment data can include, but are not limited to, operating anaugmented reality device to capture a photographic, a LiDAR (LightDetection and Ranging) scan, and/or a RADAR (Radio Detection andRanging) scan.

The systems and methods disclosed herein can generate augmented realityvisualizations of the site with the merchandisable item(s) beingconsidered for acquisition represented as an overlay to the augmentedreality visualizations of the site. The systems and methods disclosedherein can also enable the user to dynamically interact with therepresentations of the merchandisable items within the augmented realityvisualizations of the site, including the real-world objects within thesite. This can then enable the consumer to visually appreciate theplacement and/or usage of the merchandisable item within the intendedsite. In some embodiments, the systems disclosed herein can alsodetermine whether the item would physically and functionally fit withinthe intended site. For example, the system can determine whether theitem could be operated in accordance with its core product functionalityduring operation or general use within the site boundary.

Machinery is one such example merchandisable item. Acquiring machinerycan be complicated as there are many considerations, such as where themachinery will be used, its intended use, the attachments that may beneeded, how the machinery will be transported to the site, aspects ofthe installation process, etc. Machinery acquisition can also bedifficult as each piece of equipment has unique features and may be invarying (or unknown) working conditions. This acquisition process iseven more complicated when conducted online since the customer wouldhave no physical access to the equipment. Selecting unsuitable machineryand having that machinery delivered to the site to then discover it isunsuitable would result in significant financial losses (due to thefinancial investment in the acquisition as well as the likely projectdelays that would result).

One challenge when acquiring machinery is the difficulty in accuratelydetermining whether the machinery would fit within the intended site andwhether that machinery would work within the intended site to itsfullest capacity. Manual measurements of an intended site to identify amachinery are prone to human errors and/or missed obstacles as the usermaking the measurements are unlikely trained to operate the machinery ortechnically knowledgeable about the machinery, and/or its compatibleattachments. There are many factors to consider when fitting machineryto the site and the customer making the measurement may not be familiarwith potential obstacles that will limit the functionality of themachinery. For example, a customer looking to acquire an excavator froman online provider may not be familiar with the range of motion of theexcavator arm or may not be able to visualize how much volume themachinery would occupy within the site. Also, customers who may befamiliar with a certain make of the machinery may not be familiar withthat machinery by another manufacturer or the machinery with differentdimensions and/or functionalities. Being able to visualize and interactwith the machinery within the intended site before the machinery isacquired and transported would mitigate against possible losses.

The systems and methods disclosed herein enable a user to dynamicallyinteract with machinery within an augmented reality environmentrepresenting the intended site (including the real-world objects withinthat site). The described systems and methods also enable the user tooperate the machinery within the augmented reality environment in a waythat mirrors a real-life operation of the machinery within the intendedsite. For example, based on interaction requests received via theaugmented reality device, the disclosed systems can display themachinery based on that interaction request. When receiving theinteraction requests and/or when the representation of the machinery isfirst included as the overlay to the augmented reality environment, thedisclosed systems can determine whether the machinery would fit and beoperated accordingly within the intended site.

The systems and methods also enable the user to alternate between thevarious attachments to dynamically interact with the machinery withinthe site, including independent interaction with each machinerycomponent (such as but not limited to machinery arms, attachments,etc.). Users can then explore and visualize the operation of themachinery (e.g., excavator arm extended or raised, etc.) with differentattachments (such as, but not limited to, quick couplers, buckets, tiltrotators, hydraulic thumbs, etc.) for various use cases within the site.For example, the disclosed systems can receive an interaction request toadd a clamping attachment to a base machinery. The disclosed systems canalso receive an interaction request from the user to operate theclamping attachment via the augmented reality device, such as to “clamp”with the clamping attachment. The interaction request to add and operatethe clamping attachment can be received as one or separate interactionrequests. In another example, the disclosed systems can receive aninteraction request to replace the clamping attachment with a bucketattachment. The interaction request in respect of the bucket attachmentcan include operating the bucket attachment up and down. Users canbenefit from a more realistic experience on how the machinery and thevarious attachments may operate together.

Machinery is generally difficult and expensive to transport and install(particularly when dealing with specialized sizes, shapes and weight).Further, being able to dynamically interact with the machinery as it istransported, as an example, on a flatbed, will allow the acquirer orprovider to better plan transportation according to the size andoperation of the machinery and/or the attachment relative to thetransportation method.

Reference is first made to FIG. 1 , which shows a block diagram 100 ofan example dynamic interaction system 120 in communication with anaugmented reality device 110, a user device 150 and an external datastorage 130 via a network 140.

The dynamic interaction system 120 includes a system processor 122, asystem data storage 124 and a system communication interface 126. Thedynamic interaction system 120 can be implemented with more than onecomputer servers distributed over a wide geographic area and connectedvia the network 140. The system processor 122, the system data storage124 and the system communication interface 126 may be combined intofewer components or may be separated into further components. The systemprocessor 122, the system data storage 124 and the system communicationinterface 126 may be implemented in software or hardware, or acombination of software and hardware.

The system processor 122 can be implemented with any suitable processor,controller, digital signal processor, graphics processing unit,application specific integrated circuits (ASICs), and/or fieldprogrammable gate arrays (FPGAs) that can provide sufficient processingpower for the configuration, purposes, and requirements of the dynamicinteraction system 120 as will be discussed herein. The system processor122 can include more than one processor and each processor can beconfigured to perform different dedicated tasks.

The system communication interface 126 can include any interface thatenables the dynamic interaction system 120 to communicate with variouscomputing devices and other systems. In some embodiments, the systemcommunication interface 126 can include at least one of a serial port, aparallel port or a USB port. For example, the system communicationinterface 126 can receive data from or transmit data to the user device150, the augmented reality device 110, and/or the external data storage130. The system communication interface 126 may include one or more ofan Internet, Local Area Network (LAN), Ethernet, Firewire, modem ordigital subscriber line connection.

The system data storage 124 can include RAM, ROM, one or more harddrives, one or more flash drives, or some other suitable data storageelements such as disk drives, etc. The system data storage 124 can, forexample, include a memory used to store programs and an operating systemused by the dynamic interaction system 120. The system data storage 124can include one or more databases for storing information related to,but not limited to, users of the dynamic interaction system 120 (e.g.,purchasers, sellers, rental houses, dealers, manufacturers, etc.), andmerchandised items available for acquisition (e.g., equipment,attachments, pricing, delivery, availability, models representing themerchandised items, etc.). The information can be stored on one databaseor separated into multiple databases.

The external data storage 130 can store data similar to that of thesystem data storage 124, and/or different data. The external datastorage 130 can be used as a back-up data storage and/or for storinglarger files which can be retrieved or accessed directly via the network140. The external data storage 130 can, for example, be a networkattached storage (NAS) or a cloud storage. The data stored in theexternal data storage 130 can be accessed by the dynamic interactionsystem 120, the augmented reality device 110 and/or the user device 150via the network 140.

The user device 150 can include any networked device operable to connectto the network 140. A networked device is a device capable ofcommunicating with other devices through a network such as the network140. A networked device may couple to the network 140 through a wired orwireless connection.

The user device 150 can receive an input from a user and communicatewith the dynamic interaction system 120, the external data storage 130,and/or the augmented reality device 110 via the network 140. The userdevice 150 can include at least a processor, a communication interface,and a data storage, and may be an electronic tablet device, a personalcomputer, workstation, portable computer, mobile device, personaldigital assistant, laptop, smart phone, an interactive television, videodisplay terminals, gaming consoles, and portable electronic devices orany combination of these. Although only one user device 150 isillustrated in FIG. 1 , two or more user devices 150 can be incommunication with the other components illustrated in FIG. 1 .

The user device 150 may not be required for the operation of the methodsand systems described herein. In some embodiments, the functionality ofthe user device 150 can be provided by the augmented reality device 110such that no separate user device 150 is required.

The augmented reality device 110 can include any computing device thatis capable of capturing environment data for generating an augmentedreality environment based on the environment data. The augmented realitydevice 110 can include an electronic tablet device, a personal computer,a portable computer, mobile device, personal digital assistant, laptop,smart phone, an interactive television, video display terminals, gamingconsoles, and portable electronic devices or any combination of these.Although only one augmented reality device 110 is illustrated in FIG. 1, two or more augmented reality device 110 can be in communication withthe other components illustrated in FIG. 1 .

The augmented reality device 110 can include at least a device processor112, a device data storage 114, a device communication interface 116 anda sensor 118. It should be noted that the device processor 112, thedevice data storage 114, the device communication interface 116, and thesensor 118 may be combined or may be separated into further components.The device processor 112, the device data storage 114, the devicecommunication interface 116, and the sensor 118 may be implemented insoftware or hardware, or a combination of software and hardware.

The device processor 112 controls the operation of the augmented realitydevice device 110. The device processor 112 may be any suitableprocessors, controllers or digital signal processors that can providesufficient processing power depending on the configuration, purposes andrequirements of the augmented reality device 110 as will be describedherein. In some embodiments, the device processor 112 can include morethan one processor with each processor being configured to performdifferent dedicated tasks.

In some embodiments, the augmented reality device 110 can operate as thedynamic interaction system 120. For example, the dynamic interactionsystem 120 may be stored as a dynamic interaction application on theaugmented reality device 110 enabling the methods and systems disclosedherein to operate on the augmented reality device 110. The dynamicinteraction application may require access to the dynamic interactionsystem 120 and/or the external data storage 130 from time to time, orwork entirely offline as a standalone application. When operating as astandalone application, the functionality of the dynamic interactionapplication may be reduced as compared to a cloud-based operation withthe dynamic interaction system 120 via the network 140. For example,when operating as a standalone application, the dynamic interactionapplication may not be able to access all representations of themerchandised items. It may be that further downloads of data sets may berequired to increase the functionality of the dynamic interactionapplication when operating as a standalone application.

The device data storage 114 can include RAM, ROM, one or more harddrives, one or more flash drives, or some other suitable data storageelements such as disk drives, etc. The device data storage 114 can, insome embodiments, store the dynamic interaction system 120 as a dynamicinteraction application. In some embodiments, the device data storage114 can store the environmental data being captured in respect of theintended site for the object, or any other data related to dynamicinteraction with the object within the augmented reality environment.

The augmented reality device 110 includes a sensor 118. The sensor 118can include one or more different types of sensors, in some embodiments.For example, the sensor 118 can include a camera to capture environmentdata for generating an augmented reality environment based on theenvironment data via photographic, LiDAR scans, and/or RADAR scans. Thesensor 118 can include, but is not limited to, an optical sensor, anaccelerometer, a global position system (GPS) (e.g., for assisting withverification of data input measurements to improve accuracy, etc.), agyroscope (e.g., for measuring and/or maintaining orientation andangular velocity in calculating site environment while scanning, etc.),a solid state compass (e.g., two or three magnetic field sensors canprovide data for the device processor 112 to provide orientation datafor cross-verification of the GPS and gyroscopic data to align with thedevice scans, etc.), etc.

The device communication interface 116 may be any interface that enablesthe augmented reality device 110 to communicate with other computingdevices and systems. In some embodiments, the device communicationinterface 116 can include at least one of a serial port, a parallel portor a USB port. The device communication interface 116 may also includeat least one of an Internet, Local Area Network (LAN), Ethernet,Firewire, modem or digital subscriber line connection. The devicecommunication interface 116 can also include input devices, such as amouse, a keyboard, a touch screen, a thumbwheel, a track-pad, atrack-ball, voice recognition software and the like, depending on therequirements and implementation of the augmented reality device 110. Forexample, the device communication interface 116 can include a display onwhich information, such as the augmented reality environment generatedbased on the environment data, can be shown to the user. The devicecommunication interface 116 can also receive interaction requests forinteracting with the augmented reality environment.

In some embodiments, the dynamic interaction system 120 can be initiatedfrom a connection request received via the network 140 and initiated viaan internet browser application on the user device 150. FIG. 2 is ascreenshot 200 of an example user interface 210 on an internet browserapplication 202 from which the dynamic interaction system 120 can beinitiated. The user interface 210 includes various information inrespect of the example merchandised item being considered, which in thisexample is machinery 220. The user interface 210 includes photographs222 of the machinery, machinery information 224, and availableattachments 226. Also, the user interface 210 includes a button 240 withan embedded universal resource locator (URL), which, when selected, caninitiate the operation of the dynamic interaction system 120. It will beunderstood that button 240 is only an example interface element, andthat other interface elements can be provided to enable the user toinitiate the operation of the dynamic interaction system 120.

When the button 240 is selected on the user device 150 that lacks thesensor 118 required for capturing the environment data for generatingthe augmented reality representation, the internet browser application202 can direct the user to the dynamic interaction system 120 indifferent manners. In some embodiments, the internet browser application202 can generate an embedded code, such as an augmented reality QR code,which, when captured with the augmented reality device 110, wouldinitiate operation of the dynamic interaction system 120 via the network140 or the dynamic interaction application stored on the augmentedreality device 110. FIG. 3 shows an example site 300 for machinery 220with the augmented reality device 110 being moved from left to right(110 a to 110 b to 110 c) to capture the environment data as shown inthe device display generally at 302 a, 302 b and 302 c, respectively.The device display 302 shown in FIG. 3 can be triggered when the dynamicinteraction system 120 or dynamic interaction application is initiatedvia the button 240 on the internet browser application 202.

In some embodiments, the internet browser application 202 can be openeddirectly on the augmented reality device 110 and when the button 240 isselected, the dynamic interaction system 120 or dynamic interactionapplication is triggered directly to show the device display 302 on theaugmented reality device 110 for capturing the environment data.

The network 140 can include any network capable of carrying data,including the Internet, Ethernet, plain old telephone service (POTS)line, public switch telephone network (PSTN), integrated servicesdigital network (ISDN), digital subscriber line (DSL), coaxial cable,fiber optics, satellite, mobile, wireless (e.g. Wi-Fi, WiMAX), SS7signaling network, fixed line, local area network, wide area network,and others, including any combination of these, capable of interfacingwith, and enabling communication between, the dynamic interaction system120, the augmented reality device 110, the user device 150, and theexternal data storage 130.

Reference is now made to FIG. 4 , which is a flowchart of an examplemethod 400 for dynamically interacting with an augmented realityenvironment.

At 410, the dynamic interaction system 120 analyzes a site 300 in whichan object is to be placed or operated in order to capture environmentdata related to the site 300.

As described with reference to FIG. 3 , the device display 302 can betriggered in order to operate the sensor 118 of the augmented realitydevice 110 to capture environment data related to the site 300 when thedynamic interaction system 120 or dynamic interaction application isinitiated. The device display 302 can include indicators to direct theaugmented reality device 110 to be moved across the site 300 in order tocapture the environment data for estimating a site boundary. During thisenvironment data capture process, the augmented reality device 110 canoperate to detect any obstacles that may restrict the functionality ofthe object intended for the site 300. The augmented reality device 110may, in some embodiments, generate an augogram of the site 300 forgenerating the augmented reality environment of the site 300.

For example, FIG. 5 shows an example augmented reality environment 512of the site 300 provided on an example augmented reality interface 510of the dynamic interaction system 120. In this example embodiment, theaugmented reality interface 510 is provided via the dynamic interactionapplication installed on the augmented reality device 110 but, asdescribed herein, the augmented reality interface 510 can alternativelybe provided via a web-browser application in communication with thedynamic interaction system 120. Continuing with FIG. 5 , as can be seenon the augmented reality environment 512, the dynamic interaction system120 has estimated the site boundary (see generally a height 520 h, awidth 520 w, a depth 520 d) in which the object is to be positioned oroperated with the environment data captured by the augmented realitydevice 110. Similarly, the dynamic interaction system 120 can alsoidentify obstacles, such as a fountain 530, an overhead power line 532,a tree 534 and a hedge 536, and their respective estimated measurements.

The dynamic interaction system 120 may identify the obstacles byapplying various image processing techniques to the environment datacollected. For example, the dynamic interaction system 120 can applyimage processing to the environment data to identify impressions withinthe site 300 when determining the site boundary at 410 (e.g., whendetermining any of the height, width, and/or depth estimates). Theimpressions within the site 300 can correspond to obstacles that may (ormay not) interfere with an augmented reality representation of an objectonce overlaid onto the augmented reality environment 512. In someembodiments, the dynamic interaction system 120 can estimate themeasurements for the impressions based on calculations with reference tothe site boundary estimates. For example, the tree 534 and the fountain530 in FIG. 5 can both be determined by the dynamic interaction system120 as impressions with their own measurement estimates within the siteboundary in order to detect any potential interferences (e.g., if theaugmented reality representation of the object overlaps when placed ontothe site 300). Similarly, the dynamic interaction system 120, as will bedescribed, can continue to monitor any interaction with the augmentedreality representation of the object to determine if any of thoseinteraction would cause any overlap with the obstacles within the site300.

The example shown in FIG. 5 is for dynamically interacting withmachinery within the site 300. In this example, the augmented realityinterface 510 includes a machinery selection area 514 in which machineryselection buttons 514 a, 514 b and 514 c can be provided. Selection ofany of the machinery selection buttons 514 a, 514 b and 514 c wouldresult in the representation of the corresponding machinery be displayedas an overlay on the augmented reality environment 512. In someembodiments, the machinery can be selected prior to operating theaugmented reality device 110 to capture the environment data.

In some embodiments, the dynamic interaction system 120 can continue toanalyze the site 300 while the user is interacting with the augmentedreality environment 512. The dynamic interaction system 120 can adjustthe site boundary estimations during the movement of the augmentedreality device 110 (e.g., as the user rotates the augmented realitydevice 110, moves around within the site 300, etc.). For example, whencapturing the environmental data, the dynamic interaction system 120 orthe augmented reality device 110 can determine that the user is standingtoo close to the site 300 and cannot populate an object within theaugmented reality environment 512 properly. The dynamic interactionsystem 120 or the augmented reality device 110 can indicate to the userthat they need to move away from the site 300 so that the environmentdata can be captured again. The dynamic interaction system 120 cancontinue to capture the environment data and estimate the site boundaryduring this process.

At 420, the dynamic interaction system 120 displays an augmented realityrepresentation 602 of the object as an overlay of a portion of theaugmented reality environment 512 corresponding to the site 300.

Continuing to FIG. 6 , the excavator 610 has been selected with themachinery selection button 514 a. The augmented reality device 110 nowdisplays an augmented reality representation (shown generally at 602) ofthe excavator 610 as an overlay of a portion of the augmented realityenvironment 512. The augmented reality representation 602 can include athree-dimensional model of the machinery 610.

In some embodiments, when the augmented reality device 110 displays theaugmented reality representation 602 within the augmented realityenvironment 512, the dynamic interaction system 120 may automaticallyidentify obstacles within the site 300 that may limit the operation ofthe object or prevent the placement of the object at an area within thesite 300. For example, in FIG. 7A, it can be seen that the dynamicinteraction system 120 detected obstacles 702 a (tree) and 702 b(fountain) that can limit the operation of the machinery 610. To clearlyidentify the obstacles, the dynamic interaction system 120 included ageneral alert 710 on the augmented reality interface 510 as well asobstacle identification alerts 712 a and 712 b in close proximity to therespective obstacles 702 a and 702 b. The alerts 710, 712 a, 712 b areshown in FIG. 7A for illustrative purposes and it will be understoodthat other forms of alerts may be used.

At 430, the dynamic interaction system 120 receives an interactionrequest via the augmented reality device 110 for interacting with theaugmented reality representation 602 of the object.

The interaction request can include various operations in respect of theobject, such as, but not limited to, movement of the object, usage ofthe object and/or changes to accessories or features of the objects.

For example, in respect of machinery 610, FIG. 7B shows severalnavigation controls on the augmented reality interface 510, such asmovement controls 720 and 722 and rotation controls 730 a, 730 b, 732 aand 732 b, with which the user can use for providing the interactionrequest to the dynamic interaction system 120. The movement control 720can be used by the user at the augmented reality device 110 to generatean interaction request for moving the machinery 610 forward or backwardwithin the site 300, and the movement control 722 can be used by theuser at the augmented reality device 110 to generate an interactionrequest for moving the arm of the machinery 610 upwards or downwardswithin the site 300. The rotation controls 730 a and 730 b can be usedby the user at the augmented reality device 110 to generate aninteraction request for rotating the machinery 610 within the site 300,and the rotation controls 732 a and 732 b can be used by the user at theaugmented reality device 110 to generate an interaction request forrotating the arm of the machinery 610. In some embodiments, the dynamicinteraction system 120 may not provide the navigation controls on theaugmented reality interface 510 and instead, receive the interactionrequest via user inputs received directly via the touch screen on theaugmented reality device 110 and/or via other data input mechanisms.Briefly, as shown in FIG. 8 , another interaction request can include asubstitution of a machinery attachment on the machinery 610′. Theinteraction request can, in some embodiments, include multipleoperations.

FIG. 7B also shows an example interaction boundary 740. The interactionboundary 740 is a visual tool for more clearly illustrating to the useron the augmented reality device 110 various interface controls that maybe available for initiating the interaction request with the machinery610, such as movement control 722 and rotation controls 732 a and 732 b.It will be understood that the interaction boundary 740 serves as avisual aide and may not be provided in some embodiments.

At 440, the dynamic interaction system 120 determines, based on thecaptured environmental data, whether the interaction request can becompleted in respect of the object within the site 300.

When the dynamic interaction system 120 receives the interaction requestvia the augmented reality device 110, the dynamic interaction system 120assesses whether the operation(s) within the interaction request can becompleted within the site boundary of the site 300. As described withreference to FIG. 3 , the environment data captured at 410 can be usedto estimate the site boundary as well as to identify any obstacles thatmay restrict the functionality of the object intended for the site 300.

FIG. 7C, for example, shows the interaction request involves an upwardarticulation of the arm of the machinery 610. However, the dynamicinteraction system 120 determined that the requested upward movement ofthe arm would exceed the site boundary due to an obstacle 702 c(overhead power line). The obstacle 702 c in this example embodiment isalso identified with an obstacle identification alert 712 c.

Continuing from 440, if the dynamic interaction system 120 determinesthat the interaction request cannot be completed in respect of theobject within the site 300, the dynamic interaction system 120 proceedsto 460 to indicate on the augmented reality device 110 that theinteraction request cannot be completed within the site 300. In theexample shown in FIG. 7C, the dynamic interaction system 120 canindicate that the operating range of the machinery 610 is restricted bythe site boundary and/or the obstacle 702 c within the site 300. Thedynamic interaction system 120 can, in some embodiments, also indicatethat the machinery 610 is unsuitable for the site 300 (e.g., aninterference will take place). In some embodiments, the user may chooseto override the alerts generated in respect of the interference(s) andproceed with the interaction request. The dynamic interaction system 120can recommend an alternative machinery suitable for the site 300. Aswill be described, the recommendation can be for an alternativemachinery and/or a component of the machinery, such as an attachment.

To determine the alternative machinery for the site 300, the dynamicinteraction system 120 can determine a weight category of a suitablemachinery for the site boundary. Machinery is often divided into weightcategories, or size groups, depending on various factors, such as theirsize and operating space required. For example, four classes ofexcavators may be available, such as (i) mini or compact excavators,(ii) midi excavators, (iii) standard excavators, and (iv) largeexcavators.

Mini or compact excavators can be suitable for working in tight spacesaround or in existing structures, landscaping and sidewalks. In somejurisdictions, mini or compact excavators can be transported by Class 1or 2 size trucks which require no Commercial Drivers License. Mini orcompact excavators are versatile and fuel-efficient, but lack the reach,dig depth and lift capacity of standard-sized models. Midi excavatorscan be designed to deliver more dig depth, reach and power to tight workareas. Some models are available with zero or near-zero tail swing.Standard excavators can often be the most common excavators incommercial construction. They are a sizable step up in power andcapacity, while remaining maneuverable and versatile. The hydraulicsavailable in standard excavators can handle multiple tools but theheavier working weight increases hydraulic pressure and requires largertrailers for transport. Large excavators are the most powerful choicefor heavy construction, demolition and truck loading. Oversized trucksand trailers are required for transport of large excavators, and theyoccupy significant floor space when not in use. Large excavators requirehigh utilization to get steady return on machine investment.

Based on the site boundary determined with the environment datacaptured, the dynamic interaction system 120 can determine the weightcategory that is suitable for the site 300. The dynamic interactionsystem 120 can then determine whether the machinery 610 is available inthe suitable weight category. FIG. 7C, for example, includes arecommendation selection area 760 from which recommended machineryselection buttons 760 a and 760 b are displayed. As described withreference to FIG. 7C, the dynamic interaction system 120 determined thatthe machinery 610 is too large for the site 300 and identified anotherweight category that is suitable for the site 300. The recommendedmachinery selection buttons 760 a and 760 b correspond to smallermachinery that would not be limited by the obstacles 702 a, 702 b and702 c while also offering similar, if not equivalent, functionality asthe machinery 610.

The dynamic interaction system 120 can, in some embodiments, recommendaccessories that may be more suitable for the site 300 and/or thetask(s) intended for the object to be placed in the site 300. FIG. 7Dshows that the dynamic interaction system 120 detected the obstacle 702b (fountain). The dynamic interaction system 120 can determine that thebucket attachment on the machinery 610 is unsuitable for the site 300 asit will not be able to navigate from the obstacle 702 b. The dynamicinteraction system 120 can then suggest alternative attachments, asshown in the updated recommendation selection area 760′ in whichrecommended attachment selection buttons 762 a, 762 b and 762 c aredisplayed. The alternative attachments may be based on the categoryand/or manufacturer of the machinery 610. In some embodiments, thedynamic interaction system 120 may offer recommendations on attachmentsin an effort to upsell to the user.

In some embodiments, the recommendations offered by the dynamicinteraction system 120 may be filtered by the user based on variouscategories, such as, but not limited to, manufacturer.

Once the alternative machinery and/or attachment are selected for thesite 300, the dynamic interaction system 120 may then prompt the user tocomplete the transaction for acquiring the alternative machinery as willbe described with reference to FIGS. 9A and 9B.

In some embodiments, the dynamic interaction system 120 may request thatthe site 300 be analyzed again at 410 with the augmented reality device110 when it is determined that the interaction request cannot becompleted. This may improve the quality and increase the amount ofenvironment data captured in respect of the site 300 and enable improvedrecommendations offered by the dynamic interaction system 120.

Continuing from 440, if the dynamic interaction system 120 determinesthat the interaction request can be completed in respect of the objectwithin the site 300, the dynamic interaction system 120 proceeds to 450to display the augmented reality representation 602′ of the object inaccordance with the interaction request on the augmented reality device110. FIG. 8 shows the augmented reality interface 510 includes anextended machinery selection area 814 in which various attachmentselection buttons 816 a, 816 b, 816 c and 816 d are provided. In thisexample, the dynamic interaction system 120 received the interactionrequest for changing the machinery 610 to a smaller size, such asmachinery (corresponding to recommended machinery selection button 760b) and replacing the bucket attachment with the tooth bucket attachment810 (corresponding to attachment selection button 816 b). The augmentedreality representation 602′ shows the new machinery 610′ with the toothbucket attachment 810.

In some embodiments, the dynamic interaction system 120 can also providesensory feedback to the user via the augmented reality device 110 as theinteraction takes place, such as sound of motor when the machinery 610is moving.

In some embodiments, the dynamic interaction system 120 can enableoperator-training applications. The dynamic interaction system 120 mayincorporate projection mapping technology. Projection mapping canaugment real-world objects with which users can interact to enablemachinery operation training. For example, operator testing cabins canbe outfitted with augmented reality sensors (e.g., cameras) to scan theenvironment to offer the operator a cabin view which would mimicoperation of the machinery 610 in a real-life environment while actuallyon-site.

Reference will now be made to FIGS. 9A and 9B. FIG. 9A shows that theaugmented reality interface 510 can include a checkout button 902 sothat the user can complete the acquisition of the machinery 610′ and/orthe attachment 810. When the checkout button 902 is selected, thedynamic interaction system 120 can then direct the user to a checkoutinterface 910 for completing the transaction. In some embodiments, theaugmented reality interface 510 may be terminated when the checkoutprocess is initiated so that the transaction completes via the webbrowser application from which the operation of the dynamic interactionsystem 120 was initiated.

It will be appreciated that numerous specific details are describedherein in order to provide a thorough understanding of the exampleembodiments described. However, it will be understood by those ofordinary skill in the art that the embodiments described herein may bepracticed without these specific details. In other instances, well-knownmethods, procedures and components have not been described in detail soas not to obscure the embodiments described herein. Furthermore, thisdescription and the drawings are not to be considered as limiting thescope of the embodiments described herein in any way, but rather asmerely describing the implementation of the various embodimentsdescribed herein.

The embodiments of the systems and methods described herein may beimplemented in hardware or software, or a combination of both. Theseembodiments may be implemented in computer programs executing onprogrammable computers, each computer including at least one processor,a data storage system (including volatile memory or non-volatile memoryor other data storage elements or a combination thereof), and at leastone communication interface. For example and without limitation, theprogrammable computers (referred to as computing devices) may be aserver, network appliance, embedded device, computer expansion module, apersonal computer, laptop, personal data assistant, cellular telephone,smart-phone device, tablet computer, a wireless device or any othercomputing device capable of being configured to carry out the methodsdescribed herein.

In some embodiments, the communication interface may be a networkcommunication interface. In embodiments in which elements are combined,the communication interface may be a software communication interface,such as those for inter-process communication (IPC). In still otherembodiments, there may be a combination of communication interfacesimplemented as hardware, software, and combination thereof.

Program code may be applied to input data to perform the functionsdescribed herein and to generate output information. The outputinformation is applied to one or more output devices, in known fashion.

Each program may be implemented in a high level procedural or objectoriented programming and/or scripting language, or both, to communicatewith a computer system. However, the programs may be implemented inassembly or machine language, if desired. In any case, the language maybe a compiled or interpreted language. Each such computer program may bestored on a storage media or a device (e.g. ROM, magnetic disk, opticaldisc) readable by a general or special purpose programmable computer,for configuring and operating the computer when the storage media ordevice is read by the computer to perform the procedures describedherein. Embodiments of the system may also be considered to beimplemented as a non-transitory computer-readable storage medium,configured with a computer program, where the storage medium soconfigured causes a computer to operate in a specific and predefinedmanner to perform the functions described herein.

Furthermore, the system, processes and methods of the describedembodiments are capable of being distributed in a computer programproduct comprising a computer readable medium that bears computer usableinstructions for one or more processors. The medium may be provided invarious forms, including one or more diskettes, compact disks, tapes,chips, wireline transmissions, satellite transmissions, internettransmission or downloadings, magnetic and electronic storage media,digital and analog signals, and the like. The computer useableinstructions may also be in various forms, including compiled andnon-compiled code.

Various embodiments have been described herein by way of example only.Various modification and variations may be made to these exampleembodiments without departing from the spirit and scope of theinvention, which is limited only by the appended claims. Also, in thevarious user interfaces illustrated in the drawings, it will beunderstood that the illustrated user interface text and controls areprovided as examples only and are not meant to be limiting. Othersuitable user interface elements may be possible.

1.-50. (canceled)
 51. A method for dynamically interacting with anaugmented reality environment via an augmented reality device, themethod comprising: analyzing, with the augmented reality device, a sitein which an object is to be placed to capture environment data relatedto the site; displaying on the augmented reality device an augmentedreality representation of the object as an overlay of a portion of anaugmented reality environment corresponding to the site; receiving aninteraction request via the augmented reality device for interactingwith the augmented reality representation of the object; determining,based on the captured environmental data, whether the interactionrequest can be completed in respect of the object within the site,wherein the interaction request comprises an active engagementcorresponding to one or more real-world usages of the object; and inresponse to determining that the interaction request can be completed,displaying, on the augmented reality device, the augmented realityrepresentation of the object in accordance with the interaction request,otherwise, indicating on the augmented reality device that theinteraction request cannot be completed within the site.
 52. The methodof claim 51, wherein analyzing the site comprises capturing theenvironmental data for estimating a site boundary of the site in whichthe object is to be placed.
 53. The method of claim 51, whereinanalyzing the site comprises detecting one or more obstacles for theobject within the site.
 54. The method of claim 51, wherein analyzingthe site comprises analyzing the site during interaction with theaugmented reality environment.
 55. The method of claim 52, wherein:determining whether the interaction request can be completed for theobject within the site comprises determining whether an operating rangeof the object for completing the interaction request is restricted byone or more of the site boundary and an obstacle within the site; andindicating on the augmented reality device that the interaction requestcannot be completed within the site comprises indicating that the objectis unsuitable for the site.
 56. The method of claim 55, whereinindicating that the object is unsuitable for the site comprisesindicating the operating range of the object is restricted by the one ormore of the site boundary and the obstacle within the site.
 57. Themethod of claim 55, wherein indicating that the object is unsuitable forthe site comprises recommending an alternative object suitable for thesite.
 58. The method of claim 51, wherein indicating on the augmentedreality device that the interaction request cannot be completed withinthe site comprises requesting the site to be analyzed again with theaugmented reality device.
 59. The method of claim 51 wherein indicatingon the augmented reality device that the interaction request cannot becompleted within the site further comprises displaying on the augmentedreality device at least one cause preventing completion of theinteraction request.
 60. The method of claim 59 receiving an overrideinput from the augmented reality device to initiate completion of theinteraction request and to disregard the at least one cause preventingcompletion of the interaction request.
 61. The method of claim 51,wherein indicating on the augmented reality device that the interactionrequest cannot be completed within the site comprises displaying one ormore alternative objects suitable for the site.
 62. The method of claim61, further comprises determining the one or more alternative objectsbased on one or more of a user preference and a historical user data.63. The method of claim 51 further comprises receiving an override inputfrom the augmented reality device to initiate completion of theinteraction request in response to the indication that the interactionrequest cannot be completed within the site.
 64. The method of claim 51,wherein the interaction request comprises operating the augmentedreality representation of the object within the augmented realityenvironment.
 65. The method of claim 51 further comprises receiving atransaction request for the object via the augmented reality device. 66.The method of claim 51 further comprises receiving, at the augmentedreality device via a network, a user input from a remote device inrespect of the interaction request.
 67. The method of claim 51, whereinthe interaction request comprises an engagement with one or morecomponents of the object.
 68. The method of claim 67, wherein indicatingthat the object is unsuitable for the site further comprises: indicatingthe one or more components of the object is unsuitable for the site; andrecommending an alternative component compatible for the object andsuitable for the site.
 69. The method of claim 51, wherein the augmentedreality representation of the object comprises a three-dimensional modelof the object.
 70. The method of claim 51, wherein the object comprisesa merchandisable item.
 71. The method of claim 51, wherein the objectcomprises machinery.
 72. The method of claim 71, wherein the interactionrequest comprises operating a component of the augmented realityrepresentation of the machinery, the component corresponding to amachinery attachment on the machinery and the operation of the componentof the augmented reality representation corresponding to a real-lifeoperation of the machinery attachment within the site.
 73. The method ofclaim 72 further comprises receiving a transaction request for themachinery attachment via the augmented reality device.
 74. The method ofclaim 72, wherein indicating that the object is unsuitable for the sitefurther comprises: indicating the component of the machinery isunsuitable for the site; and recommending an alternative componentcompatible for the machinery and suitable for the site.
 75. A system fordynamically interacting with an augmented reality environment via anaugmented reality device, the system comprising a processor operable to:receive environment data captured by the augmented reality devicerelated to a site in which an object is to be placed; display on theaugmented reality device an augmented reality representation of theobject as an overlay of a portion of an augmented reality environmentcorresponding to the site; receive an interaction request via theaugmented reality device for interacting with the augmented realityrepresentation of the object, wherein the interaction request comprisesan active engagement corresponding to one or more real-world usages ofthe object; determine, based on the captured environmental data, whetherthe interaction request can be completed in respect of the object withinthe site; and in response to determining that the interaction requestcan be completed, display, on the augmented reality device, theaugmented reality representation of the object in accordance with theinteraction request, otherwise, indicate on the augmented reality devicethat the interaction request cannot be completed within the site. 76.The system of claim 75, wherein the processor is operable to estimate asite boundary of the site in which the object is to be placed.
 77. Thesystem of claim 75, wherein the processor is operable to detect one ormore obstacles for the object within the site.
 78. The system of claim75, wherein the processor is operable continue to analyze the siteduring interaction with the augmented reality environment.
 79. Thesystem of claim 76, wherein the processor is operable to: determinewhether an operating range of the object for completing the interactionrequest is restricted by one or more of the site boundary and anobstacle within the site; and indicate indicating that the object isunsuitable for the site.
 80. The system of claim 79, wherein theprocessor is operable to indicate that the operating range of the objectis restricted by the one or more of the site boundary and the obstaclewithin the site.
 81. The system of claim 79, wherein the processor isoperable to recommend an alternative object suitable for the site. 82.The system of claim 75, wherein the processor is operable to request thesite to be analyzed again with the augmented reality device.
 83. Thesystem of claim 75, wherein the processor is operable to display on theaugmented reality device at least one cause preventing completion of theinteraction request.
 84. The system of claim 83, wherein the processoris operable to receive an override input from the augmented realitydevice to initiate completion of the interaction request and todisregard the at least one cause preventing completion of theinteraction request.
 85. The system of claim 75, wherein the processoris operable to display one or more alternative objects suitable for thesite.
 86. The system of claim 85, wherein the processor is operable todetermine the one or more alternative objects based on one or more of auser preference and a historical user data.
 87. The system of claim 75,wherein the processor is operable to receive an override input from theaugmented reality device to initiate completion of the interactionrequest in response to the indication that the interaction requestcannot be completed within the site.
 88. The system of claim 75, whereinthe interaction request comprises operating the augmented realityrepresentation of the object within the augmented reality environment.89. The system of claim 75, wherein the processor is operable to receivea transaction request for the object via the augmented reality device.90. The system of claim 75, wherein the processor is operable toreceive, at the augmented reality device via a network, a user inputfrom a remote device in respect of the interaction request.
 91. Thesystem of claim 75, wherein the interaction request comprises anengagement with one or more components of the object.
 92. The system ofclaim 91, wherein the processor is operable to: indicate the one or morecomponents of the object is unsuitable for the site; and recommend analternative component compatible for the object and suitable for thesite.
 93. The system of claim 75, wherein the augmented realityrepresentation of the object comprises a three-dimensional model of theobject.
 94. The system of claim 75, wherein the object comprises amerchandisable item.
 95. The system of claim 75, wherein the objectcomprises machinery.
 96. The system of claim 95, wherein the interactionrequest comprises operating a component of the augmented realityrepresentation of the machinery, the component corresponding to amachinery attachment on the machinery and the operation of the componentof the augmented reality representation corresponding to a real-lifeoperation of the machinery attachment within the site.
 97. The system ofclaim 96, wherein the processor is operable to receive a transactionrequest for the machinery attachment via the augmented reality device.98. The system of claim 96, wherein the processor is further operableto: indicate the component of the machinery is unsuitable for the site;and recommend an alternative component compatible for the machinery andsuitable for the site.